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SUMMARY 

"nlefu.  techniques  (ire  developed  to  nolve  npecla] 
c lannen  of  linear  programming  prohlernn,  It  In  likely  that 
onl*'  wdcn  involving  between  100  and  POO  equations  will 
bo  ■uooeo»rully  computed  by  general  techniques  now  nvnll- 
nble.  Ihln  paper  dt nounreo  the*  need  to  compute  large 
ficnle  oyatwnn  ami  polritn  out  Borne  of  the  common  churaoteiv- 
intlco  of  many  practical  models  which  promts*  to  loud  to 
flhurt  cut  proeodurun . 
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3TATUS  OP  SOLUTION  OF  LA ROE  SCALP 
LINEAR  PROGRAMMING  PROBLEMS 

Talk  before 

Institute  of  Management  Solencra 
Pittsburgh,  Pennsylvania 
October  ?2, 


by 

George  U.  Dontslg 

The  purpose  of  my  talk  is  to  discuss  with  you  the  ponolbi 11  tier 
for  aolving  large  scale  linear  programming  problems.  I  shall  sound 
both  an  optimistic)  and  a  pessimistic  note.  Hie  penolmlatlo  note 
ooncsniB  the  ability  of  the  problem  fornnulator,  either  amateur  or 
professional ,  to  develop  models  that,  are  large  scale .  The  pessi¬ 
mistic)  note  also  concerns  the  Inability  of  the  problem  eolver  to 
compute  models  by  general  techniques  when  they  are  large  scale.  If 
this  is  eO,  Is  not  the  great  promise  that  the  linear  programming 
approaoh  will  solve  scheduling  and  long  range  planning  problems  with 
substantial  savings  to  the  organizations  adopting  these  methods  but 
an  Illusion  and  a  snare?  Are  the  big  problems  going  to  be  solved  ss 
they  have  always  heen  solved  —  by  a  detailed  system  of  on— the— « pot 
somewhat  natural  set  of  priorities  that  resolve  every  possible 
alternative  as  it  arises? 

Let  Ua  consider  a  modest  planner  who  is  concerned  with  the 
expansion  of  motor  production  — -  let  us  say  a  special  typo  motor 
that  requires  a  special  type  of  ■  tael  and  must  uso  tools  fabricated 
from  this  steel  and  tne  tools  which  fabricate  these  tools  also  use 


! 


this  steel .  The  tools  that  fabricate  stool  we  will  call  steel 


HM-IV; 
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capno  J.ty ,  then,  that.  fabricata  tooj  a  -  tool  capacity,  and  tliooa 

thftt  r‘lbrloat*  motora  ~  motor  capacity.  Th*  plann.r  .U  quit.  nodaat 
baoauaa  ha  la  willing  to  oonoolidata  all  of  tha  mulUtvdinoua 
aotivitiaa  and  ltema  Into  than*  MrnpU  Unu.  Ha  io  inUr*Bt«a  in 
dav*lopln«  *  program  ov*r  two  yaura  by  qunrUra,  that  meeta  a  apaol- 
fl«d  flohadulo  of  known  nalaa  and  cmt.ii  thu  largaat  atockpUa  0f 
motorn  for  any  futura  bh! o a  that  may  davalop.  Tha  initial  in van tory 
must  satisfy  tha  following  ra latlono  in  dataohad  aoefficlont  form 
for  first  two  tlma  parlodoi 
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'n.e  pattern  must  b*  repeated  for  eight;  time  perloda.  If  we 

Janote  the  upper  and  lower  blocks  by  A  and  B  reapeotively ,  the  model 
has  the  form 

10  x  8 

A 

II  A 

II  A 

rj  a 

D  A 

n  a 
n  a 

- 

Ill©  resulting  system  of  40  equations  In  90  variables  with  the 
objective  to  maximise  a  stockpile  of  motors  can  be  solved  In  s  half 
hour  on  a  modern  electronic  computer.  Let  this  planner  now  deolde 
that  hie  model  lo  entirely  too  coerce  and  that  he  muot  plan  by 
ESP-HiH.*  distinguish  two  types  of  motors  and  two  types  of  steel  and 
our  resultant  system  becomes  7  x  24 ,  14  x  24  or  164  x  330 .  At 

this  size  the  computation  would  require  about  one  week  using  one  shift 
per  day.  Prom  the  viewpoint  of  the  computer  the  planner  is  no  longer 
modeat.  However,  for  those  of  you  In  the  audience  who  have  ever 
engaged  in  programming.  It  In  clear  that  the  so-called  "detailed" 
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A 
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model  above  lo  at  beet  only  useful  an  an  ovet^-all  type  of  guide, 
but  hardly  detailed  In  u  realistic  canoe. 

1^ t  me  1 te  an  example  from  another  urea  —  the  problem  of 
routing  o a rgo  aircraft.  I<et  the  variable  r|  p  represent  the 
number  of  aircraft  of  type  k  routed  between  city  t  and  J. 

Let  us  distinguish  between  nix  types  of  aircraft,  ten  time  periods, 
and  twenty  cities.  In  addition,  consider  u  ueoond  sat  of  variables 
^ijl  whloh  la  the  tone  of  cargo  nhlpped  between  olty  1  and  J 
on  the  way  to  J.  Our  equations  become 


(?) 


Alroraft  In  -  Aircraft  out:  T  x  „  »  T  x,  . 

*-  ojk  <-  lok 

J  1 

Cargo  in  -  Co, -go  out,  aQt  *  £  y0jk  •  [  ylt|  ♦  boJ 

j 

Tantig*  Cap.  ;>  To"«««  Req.  j  £  ^ljx1jk  •  I  y^j 


U-l,.  .  ,/j)(c»i,. .  pQ) 
(k-1,. .  v?0)(c»l,.  .  .po) 
(1-1,.  ..;20)(j-lr  .  pO) 
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An  we  see  again  auoh  a  system  Involving  only  a  few  cities,  typM 
alroraft,  and  cargo  destinations  generate  eanlly  a  syatem  in  a  1000 
equations  In  10,000  unknownn.  Superficially,  a  very  dlncouruglng 
situation . 
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For  a  number  ox"  years  research  has  been  going  on,  now  centered 
at  RAND,  specifically  directed  toward  the  solution  of  large  scale 
syntema  and  my  talk  to  you  today  .lu  In  u  nature  of  a  progress  report. 
At  RAND  w*  have  a  a Imp lex  code  which  con  successfully  solve  u  system 
of  100  equations  In  any  number  of  unknowns  In  about,  five  hours.  Dy 
Buooeaoful  I  mean  It  I  c n  done  no  on  a  number  of  occasions  and  ban 
produoed  accurate  unable  results. 

Theoretically  the  machine  could  do  300  equations  hut.  It  would 
take  bo  long  that,  with  machine  failures,  reatarts,  etc,,  it  does 
not  app«ar  practical  to  do  ho.  Ww  alao  have  a  eptalal  oode  for  a 
special  type  of  problem  called  the  "machine  prooennlng"  modal. 
Mathematically,  thin  may  be  described  tto  a  slightly  generalized  typ© 
of  traneportatlon  model.  A  tranaportatton  model  as  developed  by 
Hitchcock  and  later  Independently  by  T.  C.  Koopnmna  le  of  the  form 


1-1,2, . .  .  ,m 

J-1,2, . . . ,n 

I  xucu  • Mln 


(?) 


i 


-  a. 


w  b 


x 
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We  can  slightly  generalize  It  by  replacing  the  coefficient  of 
In  the  first  equation  by  X^j. 

The  special  RAND  code  which  only  wovke  for  a  particular  choice 
c.,  can  work  out  Holutlono  to  <x  ?OG~equalion  system  of  this 
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type  in  about  an  hour. 

naelcally,  our  approach  ban  bean  to  study  a  large  number  of 
models  ao  they  arise  In  practice  to  discover  if  they  have  any  ahan- 
aofcerlatic  that  can  be  token  advantage  of  computationally.  When  we 
have  developed  a  theoretical  approach  we  often  take  a  watered-down 
voi  slon  of  the  model  that  oaf}  be  solved  directly  by  the  general  code 
und  compare  thin  with  tho  new  method.  Often  these  new  methodr  are 
powerful  enough  to  do  by  hand  what  cannot  be  achieved  by  machine. 

Qt  courne ,  sltuatlonn  of  thla  aort  are  not  new,  A  transportation 
problem  of  the  hltchcookr-Koopmann  variety  involving,  say,  a  hundred 
rowa  and  columns  combined  or  one  involving  10  rows  and  hundreds  of 
columns  can  be  nicely  handled  by  clerks.  Recently,  Cooper  and 
Chamea  and  othern  have  reported  that  they  were  aucceaaful  in  oolving 
oertaln  very  large  systems  by  hand  methods.  All  of  thlB  given  en¬ 
couragement  to  believe  that  many  large  scale  systems  will  be 
succeanfully  solved  in  the  future. 

Except  in  highly  specialized  modelo  of  the  tranoportatlon  type 
or  o there  where  unuovial  characteristic*  can  be  taken  advantage  of, 
greater  progrenn  will  be  made  by  developing  In  the  first  phaee 
consolidated  versions  of  the  model.  TYiere  are  several  reasons  for 
this.  In  the  first  place  thlo  effort  results  in  a  model  which  lo 
often  very  useful  in  itnalf,  Secondly,  it  provides  an  excellent 
dry  run  for  methodology.  In  n  word.  It  is  better  for  administrative 
and  technical  reasons  to  keep  tho  model  Initially  small. 
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Insvitnbly  th©  size  of  mode  Id  done  increase,  I  wish  to  discus*; 
uom©  devices  that,  can  groutly  rmiuoe  the  amount  of  computation.  In 
th*  first  piece  there  ipptarn  to  b*  a  number  of  important  character— 
iotica  commonly  found  in  practical  model n. 

(a)  Matrix  or  coeffioientn  is  composed  of  blocks  of  zeros. 

(b)  Within  non— zero  blocks  moat  elements  nr©  z*ro. 

(c)  Matrix  Is  often  block  triangular. 

(d)  Many  variables  have  elmple  upper  bounds  or  satisfy 

a  nyntem  of  secondary  constraints,  moot  of  which  are 
non-active  In  any  given  problem. 

Block  triangularity  lo  one  of  the  moot  promising  characteristics 
to  exploit.  The  basis  In  the  simplex  method  oonslete  In  a  selected 
subset  of  the  columns  of  the  a  oof  f  J.olents .  It  is  square,  non— 
singular  matrix  which  frotr,  one  cycle  to  the  next  is  modified  by  one 
column „  Its  inverse  or  equivalent  is  needed  on  each  Iteration.  If 
the  basis  is  of  this  form  (  1  ),  and  let  us  suppose  the  diagonal 
aubmutriaen  designated  A  (but  not  necessarily  th©  same)  are  equal's 
and  non-singular.  It  it  has  this  property  it  will  be  referred  to 
ao  "square  block  triangular."  This  form  lo  ideal  because  It  Is 
necessary  only  to  have  the  inverses  of  the  diagonal  oubmatrlceo . 
Furthermore ,  from  one  iteration  to  the  next  It  becomes  only-  neoeo- 
sary  to  modify  one  of  these  smaller  .Inverses.  Strlotiy  speaking 
most  banes  taken  from  block  triangular  systems  do  not  conform  to 
this  ideal  (situation  but  are  very  close  to  being  of  the  required 
form.  In  tills  case,  it  is  possible  by  transforming  the  matrix 
slightly  to  get  into  the  required  square  block  triangular  form. 
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*h*n  a  matrix  1  s  composed  largely  of  zeros  where  the  teros  nr* 
In  no  os  /louo  piittem,  it  Jo  often  practical  to  solve  dli-ectly  fop 
th*  prices  and  the  reprenontatlons  of  the  vectni -u  entering  the  bonis 
rather  than  to  solve  for  them  by  inauna  of  the*  inverses  of  successive 
baoea.  The  triinriportat j on  model  In  a  olanslon.1  cano  where  thin 
approach  haa  paid  off. 

When  many  variables  have  simple  upper  bounds,  It  lo  no  longer 
neceuaary  to  add  one  more  variable  und  equation  for  ouch  rjuoh 
raetramt.  Instead,  It  lo  possible  to  slightly  modify  the  original 
simplex  algorltlun  and  apply  It  to  the  nyetem  excluding  the  upper 
bounds.  Essentially,  one  replaces  a  vsrlabls  by  x  •  b  -  x.  whare 

b  1«  an  uppsr  bound  for  x  whenever  m  the  aimplex  procoon  x  reaches 
itn  upper  bound. 

Iri  irwuiy  problems  there  arc  equations  thot  may  be  coriaidored 
so  forming  a  set  of  aide  conditional  for  example,  conditions  that 
oapaolty  of  curtain  machines  lo  never  exoeeded  or  the  oharocten- 
lufclcu  of  certain  products;  o.g.,  lto  viscosity  l.s  within 
specll loatlons ,  etc.  In  most  problema  only  a  small  subnet  of  thene 
"secondary"  constraints  are  likely  to  be  active,  l.e.,  at  their 
critical  value  the  others  being  well  within  specification®  or 
capacities.  In  such  oases  it  Is  recommended  that  the  linear 
programming  problem  be  firot  solved  without  regard  to  these  secondary 
constraints.  Then  the  system  Is  enlarged  to  Include  the  secondary 
conatralnto  and  an  initial  basis  la  obtained  by  augmenting  th© 
rlnal  basis  of  the  smaller  problem.  Thin  will  rosult  In  a  basin 
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